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Abstract 

In this paper we consider two problems in frame theory. On the one hand, given a set of 
vectors JF we describe the spectral and geometrical structure of optimal completions of T by 
a finite family of vectors with prescribed norms, where optimality is measured with respect to 
majorization. In particular, these optimal completions are the minimizers of a family of con- 
vex functionals that include the mean square error and the Benedetto-Fickus' frame potential. 
On the other hand, given a fixed frame T we describe explicitly the spectral and geometrical 
structure of optimal frames Q that are in duality with T and such that the Frobenius norms of 
their analysis operators is bounded from below by a fixed constant. In this case, optimality is 
measured with respect to submajorization of the frames operators. Our approach relies on the 
description of the spectral and geometrical structure of matrices that minimize submajorization 
on sets that are naturally associated with the problems above. 
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1 Introduction 



Finite frame theory is a well established research field that has attracted the attention of many 
researchers (see [3 [161 E2] for general references to frame theory). On the one hand, finite frames 
provide redundant linear encoding-decoding schemes that are useful when dealing with transmission 
of signals through noisy channels . Indeed, the redundancy of frames allows for reconstruction of 
a signal, even when some frame coefficients are lost. Moreover, frames have also shown to be 
robust under erasures of the frame coefficients when a blind reconstruction strategy is considered 
(see [U El [231 123 (211 [33]). On the other hand, there are several problems in frame theory that 
have deep relations with problems in other areas of mathematics (such as matrix analysis, operator 
theory and operator algebras) which constitute a strong motivation for research. For example, 
we can mention the relation between the Feichtinger conjecture in frame theory and some major 
open problems in operator algebra theory such as the Kadison-Singer problem (see [121 [13]). Other 
examples of this phenomenon are the design problem in frame theory, the so-called Paulsen problem 
in frame theory and frame completion problems ( [D El [101 [III [III El [IHl [19l [20l [25l [29] ) which are 
known to be equivalent to different aspects of the Schur-Horn theorem. Recently, matrix analysis 
has served as a tool to show some structural properties of minimizers of the Benedetto-Fickus frame 
potential ([21 IS]) and other convex functional in the finite setting ([3TJ j 13"T 1 152"]). 

Following [H [lTl [221 EDI EU E2], in this paper we explore new connections of problems that 
arise naturally in frame theory with some results in matrix theory related with the notion of 
(sub)majorization between vectors and positive matrices. Indeed, one of the main problems in 
frame theory is the design of frames with some prescribed parameters and such that they are 
optimal in some sense. Optimal frames F are usually the minimizers of a tracial convex functional 
i.e., a functional of the form Pf(F) = tr(/(iSjr)) for some convex function f(x), where Sjr is 
the frame operator of F . For example, we mention the Benedetto-Fickus' frame potential (i.e. 
f(x) = x 2 ) or the mean square error (i.e. f(x) = x^ 1 ) or the negative of von Neumann's entropy 
(i.e. f(x) = x log(x)). Thus, in many situations it is natural to ask whether the optimal frames 
corresponding to different convex potentials coincide: that is, whether optimality with respect to 
these potentials is an structural property. One powerful tool to deal with this type of problems 
is the notion of (sub)-majorization between positive operators, because of its relation with tracial 
inequalities with respect to convex functions as above (see Section [273]) . Hence, a (sub)-majorization 
based strategy can reveal structural properties of optimal frames. It is worth pointing out that 
(sub)-majorization is not a total preorder and therefore the task of computing minimizers of this 
relation within a given set of positive operators - if such minimizers exist - is usually a non trivial 
problem. 

In this paper we consider the following two optimality problems in frame theory in terms of 
(sub)-majorization (see Section [2] for the notation and terminology). Given a finite sequence of 
vectors Fq C % = C d and a finite sequence of positive numbers b we are interested in computing 
optimal frame completions of Fq, denoted by F, obtained by adding vectors with norms prescribed 
by the entries of b (see Section 13.11 for the motivation and a detailed description of this problem) . 
In this context we show the existence of minimizers of majorization in the set of frame completions 
of Fq with prescribed norms, under certain hypothesis on b; we also compute the spectral and 
geometrical structure of these optimal completions. Our results can be considered as a further step 
in the classical frame completion and frame design problems considered in [H El [13 [HI [T71 dH [23 
125] , In particular, we solve the frame completion problem recently posed in |20j . where optimality 
is measured with respect to the mean square error of the completed frame. 

On the other hand, given a fixed frame F for a finite dimensional Hilbert space 7i = C d , 
let T>(F) denote the set of all frames Q that are in duality with F. It is well known that the 
canonical dual of F, denoted J 7 *, has some optimality properties among the elements in T>(F). 
Nevertheless, although optimal in some senses, there might be alternate duals that are more suitable 
for applications (see [TJ [2H [23 123 (Ml EI] ) ■ In order to search for optimal alternative duals for 
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J- we restrict attention the set T>t(J~) which consists of frames Q that are in duality with J- and 
such that the Frobenius norm of their frame operators is bounded from below by a constant t. 
Therefore, in this paper we show the existence of minimizers of submajorization in T>t(J-) and we 
explicitly describe their spectral and geometrical structure (see Section 13.21 for the motivation and 
a detailed description of this problem). 

Both problems above are related with the minimizers of (sub)majorization in certain sets S 
of positive semidefinite matrices that arise naturally. We show that these sets S that we consider 
have minimal elements with respect to (sub)-majorization, a fact that is of independent interest (see 
Theorems 15.121 15.161 and 13. 12|) . Notably, the existence of such minimizers is essentially obtained 
with insights coming from frame theory. 

The paper is organized as follows: In Section [2] we establish the notation and terminology used 
throughout the paper, and we state some basic facts from frame theory and majorization theory. 
In Sections 13.11 and 13.21 we give a detailed description of the two main problems of frame theory 
mentioned above, including motivations, related results and specific notations. Section [3] ends with 
the definitions and statements of the matrix theory results of the paper, which give a unified matrix 
model for the frame problems; in order to avoid some technical aspects of these results, their proofs 
are presented in an Appendix (Section [5|). In Section [J] we apply the previous analysis of the 
matrix model to obtain the solutions of the frame problems, including algorithmic implementations 
and several examples. With respect to the problem of optimal completions, we obtain a complete 
description in several cases, that include the case of uniform norms for the added vectors. With 
respect to the problem of minimal duals, we completely describe their spectral and geometrical 
structure. The Appendix, Section [5l contains the proofs of the matrix theory results of Section [3T3l 
it is divided in three subsections in which we develop the following steps: the characterization of the 
set of vectors of eigenvalues of elements in the matrix model, the description of the minimizers for 
sub-majorization in this set, and the description of the geometric structure of the matrices which 
are minimizers for sub-majorization in the matrix model. 

2 Preliminaries 

In this section we describe the basic notions that we shall consider throughout the paper. We first 
establish the general notations and then we recall the basic facts from frame theory that are related 
with our main results. Finally, we describe submajorization which is a notion from matrix analysis, 
that will play a major role in this note. 

2.1 General notations. 

Given m € N we denote by I m = {1, . . . , m} C N and 1 = l m £ W 71 denotes the vector with all 
its entries equal to 1. For a vector x £ M m we denote by x^ the rearrangement of x in decreasing 
order, and M" 1 ^ = {x £ K m : x = x^} the set of ordered vectors. 

Given H = C d and K, = C n , we denote by L(H , /C) the space of linear operators T : T~L — > K. 
Given an operator T £ L(7i , /C), R(T) C /C denotes the image of T, kerT C % the null space 
of T and T* £ L(/C , T~L) the adjoint of T. If d < n we say that U £ L(T~L , /C) is an isometry if 
U*U = In ■ I n this case, U* is called a coisometry. If K, = % we denote by L(H) = L{% , H), by 
Ql(T-L) the group of all invertible operators in L(l-L), by L(7i) + the cone of positive operators and by 
gi(H) + = gi(n)nL(n) + . If T e L{H), we denote by a(T) the spectrum of T, by rkT = dimi?(T) 
the rank of T, and by trT the trace of T. By fixing an orthonormal basis (onb) of the Hilbert 
spaces involved, we shall identify operators with matrices, using the following notations: 

By Ai n ,d(C) = L(C d , C n ) we denote the space of complex n x d matrices. If n = d we write 
A4 n (C) = At n>n (C). 7i(n) is the M-subspace of selfadjoint matrices, Ql{n) the group of all invertible 
elements of A4 n (C), U{n) the group of unitary matrices, A4 n (C) + the set of positive semidefinite 
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matrices, and Ql{n) + = Ai n (C) + n Ql{n). If d < re, we denote by I(d, n) C A4 nj d(C) the set 
of isometries, i.e. those U G A / J n) d(C) such that £7*17 = 1^ . Given 5 G .A/f n (C) + , we write 
A(5) G M™ * the vector of eigenvalues of S - counting multiplicities - arranged in decreasing order. 
If X(S) = A = (Ai , . . . , A n ) G R% 1 , a system {hi} i&n C C n is a "ONB of eigenvectors for 5 , A " 
if it is an orthonormal basis for (C 72 such that S Hi — A^ for every i G 1^ . 

If W C % is a subspace we denote by Pw G L(7i) + the orthogonal projection onto W, i.e. 
i?(Pv^) = and ker Pw = W^. Given x, y G T~L we denote by x <g> y G L(%) the rank one 
operator given by x®y (z) = (z , y) x for every z GH. Note that if ||x|| = 1 then a; ® x = -P S pan{:r} • 

For vectors in C n we shall use the euclidean norm. On the other hand, for T G M n ,d{&) we shall 
use both the spectral norm, denoted ||T||, and the Frobenius norm, denoted ||T|| 2 , given by 

||T|| = max \\Tx\\ and ||T|| 2 = (tr T*T) 1/2 = ( ^ l^| 2 ) 1/2 . 
2.2 Basic framework of finite frames and their dual frames 

In what follows we consider (re, d)-frames. See [2J [DJ [TUJ, [3D] for detailed expositions of several 
aspects of this notion. 

Let d,n G N, with d < n. Fix a Hilbert space H = C d . A family T = {fi} ie i n G U n is an 
(n, d)-frame for Ti if there exist constants A, B > such that 

n 

A\\xf <^2\{x,fi) | 2 < B\\xf for every x£U. (1) 
i=l 

The frame bounds, denoted by Ajr,Bjr are the optimal constants in ([1]). If Ajr = Bjr we call 
T a tight frame. Since dimH < oo, a family J 7 = {/i}«ei„ is an (re, cf)-frame if and only if 
span{/j : i G I n } = %. We shall denote by F = F(n , d) the set of all (re, <i)-frames for H. 

Given T = {fi} ie i n G H n , the operator 7> G L(H , C n ) defined by 

Tjrx = ( (x , /i) ) i6ln , for every x G % (2) 
is the analysis operator of T . Its adjoint TjH- is called the synthesis operator: 

T> G L(C n , H) given by T* T v = ^ Vi h for every v = (v%, ... , v n ) G C n . 

Finally, we define the frame operator of T as Sj = Tj Tj = Yliei fi®fi ^ -^(^) + • Notice 
that, if T G F(re , d), then (Sj?x , x) = Yli£i„ \ ( x > /«) | f° r every x G so Sjr e Ql{Ti) + and 

AHMI 2 < {Sj^x,x) < Bjr |[x|| 2 for every . (3) 

In particular, j4j- = A m i n (SV) = ||,f?~~. and A max (Sj-) = ||Sj-|| = Sjr. Moreover, T is tight if 
and only if S T = \ I n , where r = tr Sjr = J2m n \\fi\\ 2 ■ 

The frame operator plays an important role in the reconstruction of a vector x using its frame 
coefficients {(x, fi) }iei n - This leads to the definition of the canonical dual frame associated to 
T: for every T = {fi}iel„ G F(re, d), the canonical dual frame associated to T is the sequence 
J 7 * G F defined by 

T* ^ S T X -T= {Sf U } teIm G F(n , d) . 
Therefore, we obtain the reconstruction formulas 

x = ^2(x, f-i) SJ 1 f i = ^2(x, SJ 1 fi) fi for every x G H . (4) 

i&n i&n 
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Observe that the canonical dual J 7 * satisfies that given x E H, then 

T T # x = ( (x , S^ 1 ft) ) ieln = ( (S- 1 x , / 4 > ) . £ln for x G « => 7> # = T T . (5) 
Hence Tjr = J w and S T # = S^ 1 T* T T S T X = S T X . 

In their seminal work [2], Benedetto and Fickus introduced a functional defined (on unit norm 
frames), the so-called frame potential, given by 

FP({/ i wj= £ u,m 2 . 

One of their major results shows that tight unit norm frames - which form an important class of 
frames because of their simple reconstruction formulas - can be characterized as (local) minimizers 
of this functional among unit norm frames. Since then, there has been interest in (local) minimizers 
of the frame potential within certain classes of frames, since such minimizers can be considered as 
natural substitutes of tight frames (see [T5J [30J EI] ) • Notice that, given T = {/i}iei„ G 7i n then 
FP (J 7 ) = tr(<Sjr) = J2iei d ^(Sf) 2 - These remarks have motivated the definition of general convex 
potentials as follows: 

Definition 2.1. Let / : [0, oo) — > [0, oo) be a convex function. Following [3D] we consider the 
(generalized) frame potential associated to /, denoted Pf, given by 

P/CF)=tr(/(S70) for T={f l } mn Gn n . A 

Of course, one of the most important generalized potential is the Benedetto-Fickus' (BF) frame 
potential. As shown in [30\ Sec. 4] these convex functionals (which are related with the so-called 
entropic measures of frames) share many properties with the BF-frame potential. Indeed, under 
certain restrictions both the spectral and geometric structures of minimizers of these potentials 
coincide (see [3D]). 

2.3 Submajorization 

Next we briefly describe submajorization, a notion from matrix analysis theory that will be used 
throughout the paper. For a detailed exposition of submajorization see [3J. 

Given x, y G R rf we say that x is submajorized by y, and write x -< w y, if 

k k 

x\ < v\ fo p every k G 1^ . 
i=l i=l 

d d 

If x < w y and trx = ^ Xi = ^ yi = try, then we say that x is majorized by y, and write x -< y. 

i=l i=l 

On the other hand we write x ^ y if Xi <y% for every i Eld- It is a standard exercise to show that 
x ^ y ==> x^ ^ y^ ==> x -< w y. Majorization is usually considered because of its relation with 
tracial inequalities for convex functions. Indeed, given x, y G M. d and / : I — > R a convex function 
defined on an interval ICR such that x, y G I d , then (see for example [3j): 

dcf d d 

1. If one assumes that x -< y, then tr f(x) = f{%i) < YI f(Hi) = * r f(v) ■ 

i=l i=l 

2. If only x -< w y, but the map / is also increasing, then still tr/(x) < tr/(y). 

3. If x -< w y and / is an strictly convex function such that tr(/(x)) = tr(/(y)) then there exists 
a permutation a of Id such that yi = x a ^ for i G ILj . 
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The notion of submajorization can be extended to the context of self-adjoint matrices as follows: 
given Si, S2 G 7i{d) we say that Si is submajorized by S2, denoted Si -< w S2, if \{Si) < w \{S2)- 
If Si -< w S2 and tr(S*i) = tr(,f>2) we say that Si is majorized by S2 and write Si ~< S2. Thus, 
Si -< 52 if and only if \{Si) ~< A(S < 2). Notice that (sub)majorization is an spectral relation between 
self-adjoint operators. 

3 Description and modeling of the main problems 

We begin this section with a detailed description of our two main problems together with their 
motivations. In both cases we search for optimal frame designs (frame completions and duals), 
that are of potential interest in applied situations. In order to tackle these problems we obtain (see 
Sections 13.11 and 13. 2\i equivalent versions of them in a matrix analysis context. In section [331 we 
present a unified matrix model and develop some notions and results that allow us to solve the two 
problems in frame theory (see Section 2]). 

3.1 Frame completions with prescribed norms 

We begin by describing the following frame completion problem posed in |20j . Let H = C d and let 
•^0 = {fi}i&n e H n ° be a fixed (finite) sequence of vectors. Let n > n be an integer; denote by 
k = n — n a and assume that rkSj- > d — k. Consider a sequence a = {a{\i & \ n G M™ such that 
||/i|| 2 = Oi for every i G I no . 

With the fixed data from above, the problem posed in [20J is to find a sequence Fi = {fi}f =no+ i € 
H k with ||/j|| 2 = eti, for n a + 1 < i < n, such that the the mean square error of the resulting com- 
pleted frame F = {Fq , Fi) = {fi}iei n € F(n, d), namely tr(5^ x ), is minimal among all possible 
such completions. It is worth pointing out that the mean square error of F = {Fq , Fi) depends 
on F through the eigenvalues \{Sj?) of its frame operator. 

Note that there are other possible ways to measure robustness of the completed frame F as 
above. For example, we can consider optimal (minimizing) completions, with prescribed norms, 
for the Benedetto-Fickus' potential. In this case we search for a frame F = {Fq , Fi) = {/i}?,<=]i n G 
F(n , d), with ||/j|| 2 = «i for n G + 1 < i < n, and such that its frame potential FP {F) = tr{Sj?) is 
minimal among all possible such completions. As before, we point out that the frame potential of 
the resulting completed frame F = {Fq , Fi) depends on F through the eigenvalues A(Sjr) of the 
frame operator of F . 

Hence, in order to solve both problems above we need to give a step further in the classical 
frame completion problem (i.e. decide whether Fo can be completed to a frame F = {Fo,Fi) with 
prescribed norms and frame operator S G 7W^(C) + ) and search for optimal (e.g. minimizers of the 
mean square error or Benedetto-Fickus' frame potential) frame completions with prescribed norms. 

At this point a natural question arises as whether the minimizers corresponding to the mean 
square error and to the Benedetto-Fickus' potential, or even more general convex potentials, co- 
incide (see [21 [151 ED]). As we shall see, the solutions of these problems are independent of the 
particular choice of convex potential considered. Indeed, we show that under certain hypothesis 
on the final sequence b = {cti}2 =n +1 (which includes the uniform case) we can explicitly compute 
the completing sequences Fi = {fi}^ =Tlo+ i G % k such that the frame operators of the completed 
sequences F = {Fq,Fi) are minimal with respect to majorization (within the set of frame operators 
of all completions with norms prescribed by the sequence a). In order to do this, we begin by fixing 
some notations. 

Definition 3.1. Let Fq = {fi}i& no G H n ° and a = {aj}j e i n G M™ such that d — rkSy o < n — n a 
and || 2 = «i, i G I no . We consider the sets 

C a {F ) = { {fi}i& n G F(n , d) : {fi}m no = F and ||/i|| 2 = on for i > n Q + 1 } , 
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SC a (T ) = {S T : T G C a (Jb)} 



A 



In what follows we shall need the following solution of the classical frame completion problem. 

Proposition 3.2 ([HES]). Let B 6 M d (C) + with \(B) el^ and let b = {fii) i&k G R* . Then 
there exists a sequence (7 = {gi}iei k G with frame operator Sg = B and such that \\gi\\ 2 = fii 
for every i G 1% if and only if b -< A (5) (completing with zeros if k 7^ d). □ 

Since our criteria for optimality of frame completions will be based on majorization, our analysis of 
the completed frame T = (To , Ti) will depend on T through Sj. Hence, the following description 
of iSC a (J-o) plays a central role in our approach. 

Proposition 3.3. Let To = {fi}i& no G % n ° and a = {ai}iel n e ^>o suc ^ *^ a * ll/«ll 2 = cti, i £ I no . 
Then, we have that 

SC a (T ) = {Se gi(d) + : S>S and («i)"=n +i "< A(5 - S )} • 
In particular, if we let k = n — n a then we get the inclusion 

n 

SC a (T ) Q{S To +B: Be M d (C) + , ikB<k, tv(S To + B) = £ a*} . (6) 

i=i 

Proof. Observe that if T = (To , T\) G F(n , d), then Sjr = Sp + Sj^ ■ Denote by So = Sj- 
and B = S — So , for any S G Ql(d) + . Applying Proposition 13.21 to the matrix B (which must be 
nonnegative if S G SC a (To) ), we get the first equality. 

The inclusion in Eq. jBJ follows using that, if T = (To , T\) G F(n , d), then rkl? = rkSj^ < k = 
d — (d — k). On the other hand, recall that tr(Sj-) = J^ILi ll/dl 2 - ^ 

3.2 Dual frames of a fixed frame with tracial restrictions 

Let T = {fi}iel„ £ F(n , cZ). Then J 7 induces and encoding-decoding scheme as described in Eq. 
Q, in terms of the canonical dual J 7 *. But, in case that T has nonzero redundancy then we get 
a family of reconstruction formulas in terms of different frames that play the role of the canonical 
dual. In what follows we say that Q = {gi}iel n G F(n, d) is a dual frame for T if Tg Tjr = 
(and hence TjTg = 1%), or equivalently if the following reconstruction formulas hold: 

x = ^2(x, fi)gi = ^2(x, gi) fi for every x G H . 

i&n »€ln 

We denote by 

V(T) d = f {5GF(n,d) : 23T r = / H } 
the set of all dual frames for T. Observe that T>(T) 7^ since J 7 * G T>(T). 

Notice that the fact that T = {/i}«ei n G F(n, d) implies that T£ is surjective. In this case, a 
sequence Q G ^(J 7 ) if and only if its synthesis operator Tg is a pseudo-inverse of Tj- . Moreover, 
the synthesis operator T£ # of the canonical dual J 7 * corresponds to the Moore-Penrose pseudo- 
inverse of Tjr . Indeed, notice that T T T^ # = T T S^T* T G L(C n )+, so that it is an orthogonal 
projection. From this point of view, the canonical dual T& has some optimal properties that come 
from the theory of pseudo- inverses. Nevertheless, the canonical dual frame might not be the optimal 
choice for a dual frame from an applied point of view. For example, it is well known that there 
are classes of structured frames that admit alternate duals that share this structure but for which 
their canonical duals are not structured ([HE3]); in the theory of signal transmission through noisy 
channels, it is well known that there are alternate duals that perform better than J 7 * (|26 ] 128 1 133]) 
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when we assume that the frame coefficients can be corrupted by the noise in the channel. There 
are other cases in which J-# may be ill-conditioned or simply too difficult to compute: for example, 
it is known (see [21]) that under certain hypothesis we can find Parseval dual frames Q G T^(J~) 
(i.e. such that Sg = I-u), which lead to more stable reconstruction formulas for vectors in T-L. 

In the general case, we can measure the stability of the reconstruction formula induced by a 
dual frame Q G T)(F) in terms of the spread of the eigenvalues of the frame operator Sg; this can 
be seen if we consider, as it is usual in applied situations, the condition number of Sg as a measure 
of stability of linear processes that depend on Sg . There are finer measures of the dispersion 
which take into account all the eigenvalues of Sg , if one restricts to the case of fixed trace. As an 
example of such a measure we can mention the Benedetto-Fickus' potential. Our approach based 
on majorization - which is the structural measure of the spread of eigenvalues for matrices with a 
fixed trace - allows us to show that minimizers with respect to a large class of convex potentials 
coincide. The main advantages of considering the partition of T>{F) into slices determined by the 
trace condition tr(Sg) = t are: 

• There exists a unique vector v(t) of eigenvalues which is minimal for majorization among the 
vectors \{Sg), for dual frames Q G TJ(F) with with tr Sg = t. 

• Moreover, the vector u{t) is also submajorized by the vectors \{Sg) for every Q G T^{F) with 
with tr Sg > t. 

• The map 1 1— > u(t) is increasing (in each entry) and continuous. 

• Continuous sections t 1-4 Qt G ^(J 7 ) such that \{Gt) = v(t) can be computed. 

• In addition, the condition number of u(t) decreases when t grows until a critical point (which 
is easy to compute). 

We point out that both the vector v(t) and the duals Qt can be computed explicitly in terms of 
implementable algorithms. In order to obtain a convenient formulation of the problem we consider 
the following notions and simple facts. 

Definition 3.4. Let T G F(n , d). We denote by 

SV{F) = {Sg : Q G V(F)} 

the set of frame operators of all dual frames for T . A 
Proposition 3.5. Let T G F(n, d). Then 

SV{T) = {S^+B: BeM d (C) + and rkB<n-d}. (7) 

Proof. Given Q G F(n , d), then Q G V{F) Z = Tg - 7> # G L(U , C n ) satisfies Z*T r = 0. 

In this case, by Eq. ([5]), we know that Tjr# = Tj S^} Z*Tjr# = 0, and 

Sg = (?># + Z)* (Tjr# +Z) = S F #+B = S T l + B , where B = Z*Z G M d (C) + . 

Moreover, Sjr = TjrTjr G Ql{d) + ==^ rkXj- = d, and the equation T^Z = implies that 

R(Z) C kerT£ = RiTjr) 1 - => rkB = vk(Z*Z) = rkZ < n - d . 

Since any B G .Md(C) + with rki? < n — d can be represented as B = Z*Z for some Z G 
L(U , RiTjr) 1 ), we have proved Eq. (0). 

□ 

Fix a system F = {/j}«ei„ € F(n , d). Notice that Proposition 13.51 shows that if Q G T>{F) then 
Sjr# < Sg, which is a strong minimality property of the frame operator of the canonical dual J 7 *. 
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As we said befire, we are interested in considering alternate duals that are more stable than 
In order to do this, we consider the set T>t{J-) of dual frames Q G D(J-) with a further restriction, 
namely that tr(Sg) > t for some t > tr(Sy#). Therefore, the problem we focus in is to find dual 
frames Qt G T>t(J-) such that their frame operators Sg t are minimal with respect to submajorization 
within the set 

SV t {F) d = f {Sg:Qe V t (T)} . (8) 
Notice that as an immediate consequence of Proposition 13. 51 we get the identity 

SV t {F) = {S># +B: B G M d (C) + , ikB < n - d , tr(S> # + B) > t} . (9) 

As we shall see, these optimal duals Qt decrease the condition number and, in some cases are even 
tight frames. Moreover, because of the relation between submajorization and increasing convex 
functions, our optimal dual frames Qt G T>t{J~) are also minimizers of a family of convex frame 
potentials (see Definition 12.11 below) that include the Benedetto-Fickus' frame potential. 

3.3 A unified matrix model for the frame problems and submajorization 

In this section we introduce and develop some aspects of a set Ut(So , m) C A4d(C) + that will play 
an essential role in our approach to the frame problems described above (see Remark 13. 7|) . Our 
main results related with Ut(So , m) are Theorem 13.121 and Proposition 13.141 In order to avoid 
some technicalities, we postpone their proofs to the Appendix (Section [5]). 

Definition 3.6. Let 5 G M d (C) + with A(S ) = A G 1 , t = tr S , and t > t . For any integer 
m < d we consider the following subset of A^(i(C) + : 

U t (S ,m) = {S + B: Be M d {C) + , vkB <d-m , tr(,So + B) > t } . (10) 

Observe that if m < then U t (S , m) = {S G M d {C) + : S > S , tr(S) > t }. A 

Remark 3.7. As a consequence of Eq. ([6|) and Eq. ([9]) we see that the two main problems are 
intimately related with the structure of the set Ut(So , m) for suitable choices of the parameters 
S G M d (C) + , m < d and t > tr So : 

1. Note that Eq. §§§ shows that SC^To) C Ut(Sj? , in), where t = tr a and m = d — n + n . 

2. Similarly, Eq. shows that identity ST>t(J-) = Ut(Sjr# , m) where m = 2d — n. A 
Remark 3.8. Given A = A(5 ) etf 1 and m < d we look for a ^^-minimizer on the set 

A(U t (S , m) ) d = f {\{S) : S G U t (S ,m)}C|^. (11) 
Heuristic computations suggest that in some cases such a minimizer should have the form 

v = (Ai , . . . , A r , c , . . . c) G M>o with tr v = t for some r G I^-i an d c G M>o • 
Observe that if v G A(Ut(So , m) ) then A ^ v = u* . Hence we need that 

t - ELi Ai 

c = — and A r+ i < c < A r . 

a — r 

These restrictions on the numbers r and c suggest the following definitions: A 
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Definition 3.9. Let Ael^ and t G R such that tr A < t < dXi . Consider the set 
A x (t) = {r£ : p A (r , t) d = f - ~ Ej=1 Aj > A r+1 } . 



d — r 

£ 



a— i 

Observe that t > tr A t — ^ Aj > A^ , so that d - 1 6 i^(<) 7^ . The t- irregularity of the 

ordered vector A, denoted r A (t), is defined by 

r\{t) = min A\(t) = mm{r G : Px (r , t) > A r+i } . (12) 

If t > d Ai , we set r A (i) = and p A (0 ,t) = t/d. A 

For example, if to = t r A then for every r £ I<2-i we have that 

, *o) = = -^1 > A r +i <^ A r+ i = X d . 

a — r d — r 

Therefore in this case 

• If A = c\ d for some c G R>o , then r A (to) = 0. 

• If Ai > Xd , then 

r\(to) + 1 = min{? G I d : A t = A d } and r A (t ) = max{r G : A r > X d } . (13) 
Definition 3.10. Let A G R+^ and to = tr A. We define the functions 

r A : [to , +00) — >• {0, . . . , d — 1} given by r A (s) = the s-irregularity of A (14) 

s - Y rA(s) A 

c A : [t , +00) ->■ R> given by c A (s) = £> A (r A (s) , s) = — 1=1 , (15) 

d-r\(s) 



for every s G [to , +00), where we set Yl Aj = 0. A 

i=l 

Fix A G R+^. As we shall show in Lemma I5T81 the vector v = (Ai , . . . , X rx u) , c A (t) ld-r A (t)) £ 
R^q^ for every t > to , and the map c A is piece-wise linear, strictly increasing and continuous. This 
last claim allows us to introduce the following parameter: given m G 1^— 1 we denote by 



m 



s* = s*(X,m) = (X m ) = ^2 Xi + (d - m) X m (16) 

i=l 

that is, the unique s G [to , +00) such that c A (s) = X m . These facts and other results of Section [5] 
give consistency to the following definitions: 

Definition 3.11. Let A G R+ ^, to = tr A. Take an integer m < d. If m > and t G [to , +00) let 

' c A (t) if t < s* 

and 



C\,rn(t) 



X m + if t > S* 

" L d—m 



r\, m {t) = min{r G l d -\ U {0} : c A , m (t) > A r+ i} . 
If m < and t G [to , +00) we define c A m (t) = c A (t) and r A)m (t) = r A (t). A 
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Note that, by Eq. (|3ip of Lemma 15.81 r\ m (t) = r\(t) for every t < s* . The following results will 
be used throughout Section HJ see the Appendix (Section E]) for their proofs. 

Theorem 3.12. Let So G .Md(C) + with A = A(So) and m < d be an integer. For t > tr So , let us 

denote by r' = max{r Ajm (i),m} and c = c\ m (t). Then, there exists v G A(Ut(So , m) ) such that 

1. The vector v is -< w -minimal in A(Ut(So , m) ), i.e. v -< w /j, for every /x G A(Ut(So , m) ). 

2. For every matrix S G Ut(So , m) the following conditions are equivalent: 

(a) X(S) = v (i.e. S is -< w -minimal in Ut(So , m)). 

(b) There exists {vi}i£i d , an ONB of eigenvectors for Sq , A such that 

d-r' 

B = S - Sq = — K'+i) V-r'+i ® Vr'+i ■ (17) 

i=l 

3. If we further assume any of the following conditions: 

• m < 0, 

• m > 1 and X m > A m+ i , or 

• m > 1 and A m = X m +i but t < s*(X, m) (see Eq. \16\ ). 

then B and S are unique. Moreover, in these cases Eq. (|17p holds for any ONB of eigenvectors 
of So as above. □ 

Remark 3.13. Suppose that m > 1. In this case the map c\ m (-) is continuous and strictly 
increasing. Indeed, by Lemma [5781 we know that s* = YliLi Xi + (d — m) X m . Hence 

c\, m (t) = X m + 3 — — = J for every t > s* . (18) 

a — m a — m 

The fact that the map c\ is continuous and strictly increasing will be also proved in Lemma 15.81 
Let us abbreviate by r = r\ m (t) for any fixed t > s*. Then, if r > we have that 

t — s* 

r < m and A r > c\, m (t) = X m + > A r+ i . (19) 

a — m 

Finally, notice that the previous remarks allow to define 

m 

s** = c^ m (Ai) = (d - m) Ai + X 3 ^ s * ( with equality A x = X m ) . (20) 

i=i 

Then cx, m (t) > Ai and r = r\ tm (t) = for every t > s** (by Definition I3.11|) . These remarks are 
necessary to characterize the vector v of Theorem 13.121 A 

Proposition 3.14. Let Sq 6 Md(C) + with X = X(So), to = tr(«So) and m € Z such that m < d. 
Fix t E [to , +oo) and denote by r = r\ m (t) . Then, the minimal vector v = is(X , m, t) G IR+ ^ o/ 
Theorem VJ.12\ has tr v = t and it is given by the following rule: 

• lfm<0 then v = (A a , . . . , A r , c A , m (t) td-r) = (Ai , . . . , A r , c A (i) l d _ r ). 
If m > 1 we have that 

• v = (Ai , . . . , A r , c\ jm (t) td-r) for t < s* (so that r > m and c\ jm (t) < X rn ). 

• u = ... , \. , cx, m (t) l d -m , X r+1 , ... , X m ^j for t G (s* , s**), anrf 

• f = (cA,m(*) ld-m , Xi , . . . , A m ) /or t > s** . 

If Ai = A m , i/ie second case above disappears. □ 
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4 Solutions of the main problems 

In this section we present the solutions of the problems in frame theory described in Section Our 
strategy is to apply Theorem 13.121 and Proposition 13.141 to the matrix-theoretic reformulations of 
these problems obtained in Sections 13.11 and 13.21 We point out that our arguments are not only 
constructive but also algorithmically implementable. This last fact together with recent progress 
in algorithmic constructions of solutions to the classical frame design problem allow us to effec- 
tively compute the optimal frames from Theorems 14.31 and 14. 121 below (for optimal completions see 
Remarks 14.51 14.61 and Section 14.21 for optimal duals see Remark 14.141 and Example I4.15P . 

4.1 Optimal completions with prescribed norms 

Next we show how our previous results and techniques allow us to partially solve the frame com- 
pletion problem described in Section [3J] (which includes the problem posed in [20]). We begin by 
extracting the relevant data for the problem: 

4.1. In what follows, we fix the following data: A space % = C d . 
Dl. A sequence of vectors Fq = {fi}i£i no G H n °. 

D2. An integer n > n . We denote by k = n — n . We assume that rkSjF > d — k. 
D3. A sequence a = {aj}j e n n G M™ such that ||/i|| 2 = «j for every i G I no . 
D4. We shall denote by t = tr a and by b = {aj}" =no+1 G M> . 
D5. The vector A = A(S> ) G R^>. 

D6. The integer m = d — k = (d + n a ) — n. Observe that d — m = k = n — n a . A 

In order to apply the results of Section 13.31 to this problem, we need to recall and restate some 
objects and notations: 

Definition 4.2. Fix the data J-q = {fi}iei no and a = {ai}iei n as in 14.11 Recall that t = tra, 
A = A(Sj- ) and m = d — k. We rename some notions of previous sections: 

1. The vector v(J-o , a) = v € M> of Theorem 13.121 (see also Proposition 13.14]) . 

2. The number c = c(J r o ; a ) == c\,m{t) (see Definition 13. lip . 

3. The integer r = r(J-"o , a) = max{r^ m (t) , m} (see Definition I3.1ip . Note that d — r < k. 

4. Now we consider the vector 

H = fi(T , a) = ( c( Jb , a) - X r+j ) G (R^ r )t . 

Observe that tr // = tr v — tr A = t — ^ ll/«l| 2 = tr a — ^ «j = tr b. A 

i£ln ielno 

Throughout the rest of this section we shall denote by So = S^ the frame operator of Tq . Recall 
the following notations of Section I3.lt 

C a (.Fo) = { {fi}iei n S F(n , d) : {fi}m no = and ||/j|| 2 = a { for i > n a + 1 } , 

5C a (Jb) = {St' J" € C a (Jo)} and A a (Jb) = {A(5) : S G SC a {T )} . 
Theorem 4.3. Fix the data of \4-l\ and \4-^\ If we assume that b -< h{J-q , a) then 
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1. The vector v = v(Tq , a) G A a (J r o). 

2. We have that v -< f3 for every other (3 G Agp^)- 

5. Ze£ r = r(7" , a). Giwen T\ = {/i}^L no+1 G such that T = (To, T\) G CJ^Fq), the 
following conditions are equivalent: 

(a) X(Sj^) = v (i.e. Sj is -^-minimal in SC a (To))- 

(b) There exists , an ONB of eigenvectors for Sq , X(So) such that 

d—r 

Sti = B = y~] m h r+i <S) h r+i . (21) 
i=l 

Since, by the hypothesis, b -< fi = [i(Tq , a) then such an T\ exists. 
4. Moreover, if any of the conditions in item 3 of Theorem 13.121 holds, then 

(a) Any ONB of eigenvectors for So > X produces the same operator B via (f2T|) . 

(b) Any T = (To , F{) G C & (~Fo) satisfies that X(Sj^) = v(To , a) Sj 1 = B. 

Proof. Since the elements of C a (J-"o) must be frames, we have first to show that u(To , a) > 0. By 
the description of v = v(To , a) G * given in Proposition 13.141 there are two possibilities: In 
one case v& = A m which is positive because we know from the data given in 14.11 that rk So > m. 
Otherwise t < s* so that Ud = c(To , a) = c\(t) by Proposition 13.141 and Definition 13.111 But 
c\(t) > because b > =^> t > trSo (see Lemma 13 . 1 3 1 and Definition 13. 10p . 

By Proposition 13.21 we know that the hypothesis b -< \i = \x(To , a) assures that there exists a 
sequence T\ = {/i}™ =rio+1 G H k such that T = (To , ^i) G C & (Tq) and Sj^_ = B. Then 

X(S T ) = X(S To + S Tl ) = X(S To +B) = u(To , a) G A a (Jb) , 

by Theorem 13. 121 Observe that A a (J 7 o) C A(Ut(Sjr , m) ), by Remark 13.71 Hence the majorization 
of item 2, the equivalence of item 3 and the uniqueness results of item 4 follow from Theorem 13. 121 
Note that all the vectors of A a (To) have the same trace. So we have -< instead of ~< w . □ 

Theorem 4.4. Fix the data of \4-l\ and \4-2\ If we assume that b -< (J,(To , a) then 

1. Any T G C a (To) such that X(Sj^) = u(To , a) satisfies that 

]T f(u(T , a)i) = P f (T) < P f (G) for every Q G C a (T ) , 

and every (not necessarily increasing) convex function f : [0, oo) — > [0, oo). 

2. If f is strictly convex then, for every global minimizer T' of Pj(-) on C a (To) we get that 
X(S TI )=v(T ,a). 

In particular the previous items holds for the Benedetto- Fickus ' potential and the mean square error. 

Proof. It follows from Theorem 13.121 and the majorization facts described in Section T2.31 □ 

Fix the data To and b of 14.11 and 14.21 We shall say that "the completion problem is feasible" if 
the condition b -< /j,(Tq , a) of Theorem 14.31 is satisfied. 

Remark 4.5. The data v(To , a), r(To , a), c(Tq , a) and n(To , a) are essential for Theorem 14. 3\ 
both for checking the feasibility hypothesis b -< fx(To , a) and for the construction of the matrix 
B of (|2ip . which is the frame operator of the optimal extensions of To ■ Notice that the vector 
fj,(To , a) measures how restrictive is the feasibility condition. Fortunately, this condition can be 
easily computed according to the following algorithm: 
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1. The numbers t = tr a and m = d — k are included in the data 14. ll 



2. The main point is to compute the irregularity r = r(J-Q , a) = max{r\ tTn (t) , m}. If m < 
then (|12p allows us to compute r\(t). If m > 1, the number s* = s*(A , m) of Eq. (|16p allows 
us to compute r : If i > s* then r = m by Eq. (|19fl . and if t < s* then r = r\(t) by the 
remark which follows Definition 13.111 

3. Once r is obtained, we can see that the wideness of the allowed weights b depends on the 
dispersion of the eigenvalues (A r+ i , . . . , A^) of Sj- . 

4. Indeed, the number t\ = tr b = t — tr Sjr Q is known data. Also tr h(J-q , a) = t\ . Hence 
c(J-"o j a ) and ^(J^o , a) can be directly computed: Let s = Y2i=r+l ^» ■ Then 

ci = tr /x = (a — rj c(y-Q ; a J — s ==> c{J-q , aj — — 



d — r d — r 

And we have the vector \x = m(^o > a ) = ( c(J r o , a) — A r+J - ) € (M^q 1 ")^ . Then 

^ ' j&d-r 

p d 

b^fi «<=>■ ^ b} + A d _ i+ i < ( tr b + ^ X i ) for l<P<d-r , 

i=l i=r+l 

since the last inequalities s + X^=i b| < s + tr b (for d — r < p < k) clearly hold. 

It is interesting to note that the closer J-q is to be tight (at least in the last r entries of A), the 
more restrictive Theorem 14.31 becomes: but in this case J-q and J 7 * are already "good". 

On the other hand, if J-q is far from being tight then the sequence (A r +i , . . . , A^) has more dis- 
persion and the feasibility condition b -< fi(J-o , a) becomes less restrictive. It is worth mentioning 
that in the uniform case b = is always feasible and Theorem 14.31 can be applied. 

Observe that as the number k of vectors increases (or as the weights ai increase) the trace t grows 
and the numbers r and m become smaller, taking into account more entries A, of \{J-q) ■ This fact 
offers a criterion for choosing a convenient data k and b for the completing process. We remark 
that the vector [i (and therefore the feasibility) only depends on A, k and the trace of b, so the 
feasibility can also be obtained by changing b maintaining its length (size) and its trace. 

The above algorithm (which tests the feasibility of our method for fixed data J-q and b) can be 
easily implemented in Matlab with low complexity (see Section [4.2p . A 

Remark 4.6 (Construction of optimal completions for the mean square error). Consider the data in 
14.11 Apply the algorithm described in Remark 14.51 and assume that b -< h(J-q , a). Then construct 
B as in Eq. (|2ip . In order to obtain an optimal completion of J-q with prescribed norms we have 
to construct a sequence T\ € H k with frame operator B and norms given by the sequence b (which 
is minimal for the mean square error by Theorem 14. 4p . But once we know B and the weights b we 
can apply the results in [8] in order to concretely construct the sequence JF\ ■ In fact, in [8] they 
give a Matlab implementation which works fast, with low complexity. 

We also implemented a Matlab program which compute the matrix B as in Eq. (|21|) . This 
process is direct, but it is more complex because it depends on finding a ONB of eigenvectors for 
the matrix Sj? . In Section 14.21 we shall present several examples which use these programs for 
computing explicit solutions. A 
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Consider the data in 14.11 and 14.21 Let / : [0, oo) — > [0, oo) be an strictly convex function. By 
Remark 13.71 Theorem 13.121 and the remarks in Section 12.31 in general we have that 

J2 f(v(?0 , a)i) < Pf{F) for every T E C a (T ) . (22) 

Notice that although the left-hand side of Eq. (j22p can be effectively computed, the inequality might 
not be sharp. Indeed, Eq. (|22p is sharp if and only if the completion problem is feasible and, in this 
case, the lower bound is attained if and only if X(Sj^) = , a). Nevertheless, Eq. ([22|) provides 
a general lower bound that can be of interest for optimization problems in C a (J-o). 



4.2 Examples of optimal completions with prescribed norms 

In this section we show several examples obtained by implementing the algorithms described in 
Remarks 14.51 and 14.61 in Matlab, for different choices of To = {fi}i& no and a = {aj}j G n n (as in 
14. 1|) . Indeed, we have implemented the computation of r, c, \i and v by a fast algorithm using 



n Q +l 



L >0 



and the vector A = X(Sjr ) as data. Then, after computing the eigenvectors 



of Sjr Q with the function 'eig' in Matlab we computed the matrix B, and we apply the one-sided 
Bendel-Mickey algorithm (see |17| for details) to construct the vectors of T\ satisfying the desired 
properties. The corresponding M-files that compute all the previous objects are freely distributed 
by the authors. 

Example 4.7. Consider the frame J-q E F(7, 5) whose analysis operator is 



0.9202 
0.4556 
-0.0885 
0.1380 
0.7082 



-0.7476 
0.0164 
-0.3495 
-0.4672 
0.2412 



-0.4674 
0.0636 
-0.9103 
-0.6228 
-0.1579 



0.9164 
1.0372 
0.3672 
-0.1660 
-1.8922 



0.1621 
-1.6172 
-0.6706 

0.9419 
-0.4026 



0.3172 
0.3688 
-0.9252 
1.0760 
0.1040 



-0.5815 
0.2559 
0.6281 
1.1687 
1.6648 



The spectrum of it frame operator is A = X(Sjr Q ) = (9,5,4,2,1) and to = tr Sjr Q = 21. As in 14.11 
fix the data k = 2 and b = {ai}f =8 = (3 , 2.5) € M> , so that m = d — k = 3. We compute: 

1. The number r\ im (26.5) = 2 and the vector fi = (2.25, 3.25). Notice that, in this case, 
b = (3 , 2.5) -< (2.25, 3.25) = /i. Therefore the completion problem is feasible. 

2. The optimal spectrum is i/ A , m (26.5) = (9,5, 4.25, 4.25, 4). 

3. An optimal completion T\ of J-q , with squared norms given by b is given by: 



-0.6120 
0.9087 

-1.0680 
0.3735 

-0.1404 



-1.1534 
0.1097 
0.7154 
0.7676 

-0.7462 



4. If we take b = (3.5 , 2) then the number t = to + tr h (and so also r and fi) are the same as 
before but the problem is not feasible, because in this case b//i. 

Example 4.8. We want to complete frame J-q of Example 14.71 with 4 vectors in M 4 , whose norms 
are given by b = {a!j}?i g = (1 , 1 , \ , |) E K>o- We can compute that 

1. m = d — k = 1 and r = rA, m (23.75) = 3. 

2. The vector \x = (0.875 , 1.875), so that b -< fj, and the problem is feasible. 

3. The optimal spectrum is v = (9 , 5 , 4 , 2.875 , 2.875). 
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4. An example of optimal completion T\ of J-q , with squared norms given by b is given by: 

0.5011 -0.3543 " 
0.1224 0.0865 
0.1836 0.1299 
0.3305 0.2337 
0.3017 -0.2133 . 

5. If we take b = (2 , i , i , i) G R> the problem becomes not feasible. A 

Example 4.9. Suppose now that n = C 5 and that our original set of vectors J-q = {fi}i<=i 6 G H 
is such that the spectrum of Sj- Q is given by A = (7 , 4 , 4 , 3 , 1). Thus to = tr Sj? = 19. Let 
b = (2 , 2 , 1). Then, k = 3, m = d - k = 2 and t = 24. 

With these initial data, we obtain the values r^ iTn (24) = 1 and c,\ TO (24) = 4.33. The spectrum 
of the completion B is \i = (0.33, 1.33, 3.33) (notice that b -< /x) and the optimal spectrum is 
v\ m (24) = (7, 4.33, 4.33, 4.33, 4). However the frame operator B of the optimal completion is 
not unique, since A m = A m +i and t = to + tr b = 24 > 23 = s* (see Theorem 13. 12|) . A 



-0.7086 -0.3232 

0.1730 0.5746 

0.2597 -0.7252 

0.4674 0.1935 

-0.4267 -0.0457 



4.3 Minimizing potentials in T>t(J-) 

In this section we show how our previous results and techniques allow us to solve the problem of 
computing optimal duals in T> t {F) = {Q G F(ra , d) : Tg Tj = I and tr Sg > t} for a given frame J 7 , 
described in Section 1331 In order to state our main results we introduce the set K t {V{F) ), called 
the spectral picture of the set iSX'(J r ) (see Eq. ([SJ), given by 

K t {V{F)) = {\(Sg) : GeV t (T)} . 

Remark 4.10. Recall from Remark 13.71 that if T € F(n, d) with A = X(S^- 1 ) , m = 2d — n and 
t > tr A, then ST> t {F) = Ut(Sjr# , m). Hence, by Theorem l3.121 there exists a unique v G A t (P(J r ) ) 
that is ^^-minimizer on this set. Moreover, recall that such vector v is explicitly described in 
Proposition 13.141 A 

Theorem 4.11 (Spectral structure of Global minima in T>t{J-)). Let T = {fi}iei„ € F(n , d) with 
A = X(S^ F 1 ) , m = 2d — n and t > tr A. Let v = u(X, m, t) € IR^ ^ be as in Proposition^!^ Then, 
v G At(P(J r ) ) and we have that: 

L If Qt £ Dt(J~) is such that X(Sg t ) = v then 

/M = p /(^) ^ p f&) f° r ever y g € v t(?) » 

and every increasing convex function f : [0, oo) — > [0, oo). 

2. If we assume further that f is strictly convex then, for every global minimizer Q[ of Pf(-) on 
T>t(T) we get that X{Q' t ) = v. 

Proof. As explained in Remark 14.101 we see that v G At(D(J r ) ) is such that v < w for every 
\x G A t {T>{F)). By the remarks in Section [2~3l we conclude that, if Qt is as above and Q G DtiJ 7 ) 
then 

P f (g t ) = tr(/(5 ft )) = tr/H < tr/(A(5g)) = P f {G) , 

since X(Sg) G h t {V{F) ). Assume further that / is strictly convex and let Q[ be a global minimizer 
of Pf(-) on T>t{J-). Then, we have that 

u^ w \(s sl ) but tTf(x(Sg l )) = p f (g' t )<Pf(g t ) = tT f(u) . 

These last facts imply (see Section l2T3"j) that X(Sg>) = u as desired. □ 
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Next we describe the geometric structure of the global minimizers of the (generalized) frame po- 
tential Pf(-) in T>t(J-), in terms of their frame operators. 

Theorem 4.12 (Geometric Structure of global minima in T>t(J~))- Let T G F(n , d), m = 2d — n, 
let t > tr S^- 1 and denote by A = A(S'^ 1 ). Let f : [0, oo) — > [0, oo) an increasing and strictly convex 
function. 

1- If Q G T>t{J-) is a global minimum of Pf in T>t(P) then there exists {/tj}j e i d , an ONB of 
eigenvectors for S^- 1 , A such that 

d-r' 

Sg = Sj- 1 + ^2 ( c A,m(0 - A r / + j^ h r i +i <g> h r i +i , 
1=1 

where r' = m&x{r\^ m (t) , m}. 

2. If we further assume any of the conditions of item 3 of Theorem \3.12i there exists a unique 
St G ST>t{J-) such that if Q is a global minimum of Pf in T>t(P) then Sg = St- 

Proof. It is a consequence of Theorems 13.121 and 14.111 together with Proposition 13.141 □ 

Remark 4.13. Fix T = {/j}i e i n G F(n, d) and m = 2d - n. Denote by A = A(S'^ 1 ). If m > 
then there exist t G M>o and a constant vector 

cl d G A t (V(P) ) Ai = A m . (23) 

In this case c = Ai and £ = d Ai . The proof uses the characterization of At(T>(P) ) given in Remark 
Oand Corollary (see also Definition EE} . Indeed, if v = ct d G A t (X>(J*) ) then, by Eq. (|29|) . 

c = ^ < A m < Ai < ui = c =^ \i = \ m = c . 

Conversely, if Ai = A m and t = d Ai , then by Corollary 15.71 it is easy to see that the vector 
Ai Id G At(T>(P) ). Therefore the frame J- has a dual frame which is tight if and only if 

• m = 2d — n < 0. Recall that in this case v\ t m(t) = 4 • 1<j for every t > d \\ . 

• m G Id-i and A,2_ m+ i(S' J F) = Xd(Sj^) i.e., the multiplicity of the smaller eigenvalue Xd(Sj^) of 
Sj^ is greater or equal than m. This is a consequence of Eq. (|23p. 

In particular, if m G then there is a Parseval dual frame for T if and only if 

Xd- m+ i(Sjr) = Xd(Sjr) = 1 Sjr > I d and rk(J(2 - Sjr) < d - m = dimkerT^- . 

Observe that the equivalence also holds if 2d < n. In this case there is a Parseval dual frame for 
T <^=> Sjr > Id , because the restriction dim ker T£? = n — d> d >ik (Id — Sj^) is irrelevant. This 
characterization was already proved by Han in [21], even for the infinite dimensional case. A 

Remark 4.14. Using the characterization of T>(P) given in the proof of Proposition 13.51 every 
optimal dual frame Q = {gi}igi n is constructed from the canonical dual of T: each g% = S*^ 1 fi + hi , 
for a family P\ = {/ij}igi„ which satisfies T^ T^ = B and T^Tjr = 0. A 

As it was done with the completion problem, the previous results can be implemented in Matlab 
in order to construct optimal dual frames for a given one when a a tracial condition is imposed. 

It turns out that in this case, once we have calculated the optimal B, we must improve a different 
type of factorization of B. Now B = X*X should satisfy R(Tjr) C ker X*. In the algorithm devel- 
oped, X* = B 1 I 2 W* where B 1 / 2 has no cost of construction since we already have the eigenvectors 
of S^ 1 . In addition W is constructed using the first d — r vectors of the ONB of ker T£ (computed 
with the 'null' function) and adding r zero vectors in order to obtain annxd partial isometry. 
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Example 4.15. The frame operator of the following frame J- G F(8, 5) has eigenvalues listed by 
\ — (5 2 1 1\. 
A \2 ' ^' 3 » 3 ' 4> 



'J- 



-0.5124 
-0.4965 

0.2777 
-0.3793 

0.0725 



0.5695 
0.0478 
0.2875 
-0.7849 
-0.0803 



0.4542 
0.1579 
-0.4974 
-0.4783 
-0.2075 



-0.3527 
-0.2299 
0.0086 
-0.2566 
-0.2967 



-0.2452 
-0.9348 
0.1893 
0.3450 
-0.1518 



0.1260 
-0.6935 
-0.0916 
-0.0749 

0.2077 



0.0558 -0.3513 

-0.0836 0.7641 

0.2501 -0.0722 

-0.2939 0.3785 

-0.2050 0.4226 



Therefore, A 
Consider t = 



§) and tr S*^ 1 



= ACS'" 1 ) = (4,3,1,1 
16.5, then an optimal dual Q G "DtiJ 7 ) for J- is given by 



9.4. We also have that m = 2d 



n 



2. 



-1.0236 0.2319 

-0.2583 0.6148 

0.3080 0.6525 

-1.1868 0.1198 

0.5506 0.5428 



-0.0181 
0.5219 
-1.0323 
-0.8331 
-0.2035 



-0.5802 
0.1585 

-0.8031 
0.4816 

-0.5871 



0.0438 
0.6493 
0.2306 
0.4222 
-0.2309 



0.7316 
-0.7116 
-0.8740 
-0.0495 

1.1268 



1.0846 
0.2109 
0.2856 
-0.8551 
-0.7891 



-0.0143 
1.2138 
-0.3488 
-0.0836 
0.8432 



Here, the optimal spectrum v = u\ m (16.5) is given by v = (4, 3.166, 3.166, 3.166, 3). 



A 



5 APPENDIX - Proof of Theorem [3321 

In this section we obtain the proofs of Theorem 13.121 and Proposition 13.141 stated in Section 13.31 in 
a series of steps. In the first step we introduce the set U(So,m) := U tr ^ So ^(So,m) and characterize 
its spectral picture A(U(So,m)) - i.e. the subset of of eigenvalues A(5), for S G U(So,m) 
- in terms of the so-called Fan-Pall inequalities. In the second step we show the existence of a 
^,,,-minimizer within the set A(Ut(So,m)) and give an explicit (algorithmic) expression for this 
vector. Finally, in the third step we characterize the geometrical structure of the positive operators 
S G Ut(So,m) such that X(S) are ^-minimizers within the set A(Ut(So,m)), in terms of the 
relation between the eigenspaces of S and the eigenspaces of So. It is worth pointing out that the 
arguments in this section are constructive, and lead to algorithms that allow to effectively compute 
all the parameters involved. 

Step 1: spectral picture of U(So,m) 

Recall that ^ is the set of vectors [i G Ml with non negative and decreasing entries (i.e. \l G 
with /jr = fx); also, given S G 7W^(C) + , \(S) G denotes the vector of eigenvalues of S - 

counting multiplicities - and arranged in decreasing order. 

Given So G Aid(C) + , m < d and integer and t > tr(So) then in Eq. (fTOjl we introduced 
Ut(So , m) = {So + B : B G .Md(C) + , rkB < d — m , tr(5o + B) > t }. In this section we consider 

U(So,m):=U tT{So) (So,m) = {So + B : B G M d (C) + , ikB<d-m} 

together with its spectral picture A(U(So,m)) := A(U tl rs \(So,m)) (see Eq. (fTTj) in Remark l3.8p . 
We shall also use the following notations: 

1. Given x G C d then D(x) G Md(C) denotes the diagonal matrix with main diagonal x. 

2. If d < n and y G C d , we write (y , Q n -d) G C ra , where n -d is the zero vector of C n ~ d . In this 
case, we denote by D n {y) = D((y, n _ d ) ) G M n (C). 

Theorem 5.1. Let So G A4d{C) + , m < d be an integer and fi G Then the following 

conditions are equivalent: 

1. There exists S G U(Sq , m) such that X(S) = fi. 
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2. There exists an orthogonal projection P G M 2d - m (C) such that rkP = d and 

\{PD 2d _ m (p)P) = (A(5 ), O d . m ) . (24) 

Proof. 1 => 2. Let B G M d (C) + be such that rk(P) < d - m and A(S + B) = fi. Thus, 5 can be 
factorized as P = for some V G .A/f^-m, If 

/ Q i/2\ / c qVVA 

T= f ^ J EMid-mAV T*T = S + B and TT* = f *° /2 ^ J . (25) 

Let U G U(2d - m) be such that U(TT*)U* = D(X(TT*)) = D 2d - m (n) and let P G M 2d - m {C) be 
given by P = U P\ U* , where P\ = I d ffi Orf_ m . Notice that, by construction, P is an orthogonal 
projection with rkP = d and, by the previous facts, 

P D 2d ^ m (fi) P = UP 1 (TT*) P l U* = U ( S ° °) U* , 



which shows that Eq. (|24p holds in this case. 

2 1. Let P G M 2d- m (C) be a projection as in item 2. Then, there exists U G £/(2(i — m) such 
that U*PU = Pi, where Pi = J d © d — m as before. Hence, we get that 

\(P 1 {U*D 2d _ m {n)U)P 1 ) = A(5 ,0 d _ m ) . (26) 

Since rk(P* D 2d _ m (fi) U) < d then we see that there exist T G M 2d - m , <f(C) such that U* D 2d _ m (ij) U 
TT*. Let Ti G -M d (C) + and T 2 G -M d - m ,d(C) such that 

S) ^^-™M^ = TI-=(^i £|) . 
Then A(TiT*) = A(5 ) by Eq. ([25]). On the other hand, notice that A(T*T) = fj, and 
T*T = T*Ti + T 2 *T 2 = S x + Pi with A(5i) = A(T a T*) = X(S ) and rk(P x ) <d-m . 

Let W G U{d) such that WSiW = S . Then 5 = W*{T*T)W = S + B satisfies that A(5) = /i 
and rk(P) = rk(Ty*Pi^) < d - m. Then /x = A(T*T) = A(5) G A(U{S , m) ). □ 

Remark 5.2. Let So S M. d ( < C) + , m < d be an integer and G WL^ as in Theorem 15.11 It turns 
out that condition (|24|) can be characterized in terms of interlacing inequalities. 

More explicitly, given fi G * , by the Fan-Pall inequalities (see |27]). the existence of a projection 
P G M 2d~»n(C) satisfying ([24p for fi is equivalent to the following inequalities: 

1. fx ^ A(S'o), i.e. ^ > A* (So) for every i €l d . 

2. If m > 1 then also satisfies 

Vd-m+i < Aj(5 ) for every i G I m , 
where the last inequalities compare the first m entries of A(So) with the last m of \i. 

These facts together with Theorem 15.11 give a complete description of the spectral picture of the 
set U(Sq , m), which we write as follows. A 

Corollary 5.3. Let Sq G A4 d (C) + and m < d be an integer. Then, the set A{U(So , m )) can be 
characterized as follows: 
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1. If m < 0, we have that 

HeA(U(S ,m)) n>\(S ) . (27) 

2. If m> I, then 

fj,eA(U(S ,m)) /i^A(5 ) and fJ-d-m+i < Aj(Sb) /or i€l m . (28) 

Proof. It follows from Theorem 15.11 and the Fan-Pall inequalities of Remark 15, 2[ □ 
Corollary 5.4. Let So G -A4d(C) + and m < d be an integer. Then A(U(Sq , to)) is convex. 



Proof. It is clear that the inequalities given in Eqs. (|27p and (|28p are preserved by convex combi- 
nations. Observe that also the set ^ is convex. □ 

Remark 5.5. Let So G Aid(C) + , to < d be an integer and 5 G M.d(C) + . The reader should note 
that the fact that X(S) G A(U(Sq , to)) does not imply that S G U(Sq , to). Indeed, it is fairly easy 
to produce examples of this phenomenon. Therefore, the spectral picture of A(U(So , to)) does 
not determine the set U(Sq , to). This last assertion is a consequence of the fact that U(Sq , to) is 
not saturated by unitary equivalence. Nevertheless, A(U(So , to)) allows to compute minimizers of 
submajorization in U(So , to), since submajorization is an spectral preorder. 

Step 2: minimizers for submajorization in A(Ut(So, m)) 

The spectral picture of U (Sq , to) studied in the previous section motivates the definition of the 
following sets. 

Definition 5.6. Let AeRf 1 and take an integer to < d. We consider the set 



' {n G R^> : /i^A} if to < 



A(A, to) 



(29) 



k {/x G A(A , 0) : Hd-rn+i < Aj for every i G I m } if to > 1 . 
Denote by to = tr A. For t > to , we also consider the set 

A t (A , to) = {fi G A(A , to) : tr/i>t}. A 

Now Corollary 15.31 can be rewritten as 

Corollary 5.7. Let So G Aid(C) + with A(So) = A, to < d be an integer and t > tr(A). Then we 
have the identities A(U(So ; m )) = A(A , to) and A(Ut(So , to)) = Af(A , to) . □ 

In this section, as a second step towards the proof of Theorem l3.12l we show that the sets A^(A , to) 
have minimal elements with respect to submajorization and we describe explicitly these elements. 

Let A G ^ and to = t r A. We recall the maps r A (-) and c\(-) introduced in !3.3[ Fix t > to . Then 

1. Given r G I^-i U {0} we denote by p\(r , t) = — d ^ 3 , where we set J2j=i = 0- 

2. The maps r A : [to > +oo) — > I<2-i U {0} and c A : [to , +oo) — > M>o given by 

r A (t) = min{r G U {0} : p A (r , t) > X r+1 } and c A (t) = ! • (30) 

a - r\(t) 

In the following Lemma we state several properties of these maps, which we shall use below. The 
proofs are technical but elementary, so that we only sketch the essential arguments. 
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Lemma 5.8. Let A G and to = tr A. 

1. The function r x is non-increasing and right- continuous, with \ x (t )+i = ■ 

2. The image of r\ is the set B = {k G : A^ > A^+i} U {0}. 

3. The map c\ is piece-wise linear, strictly increasing and continuous. 
4- We have that c\(ta) = X d and c\(t) = t/d for t> dX\ . 

5. For every t G [to , dX±), if r = r x (t) then X r+ i < c\(t) < X r . In other words 

r x (t) = min {r G U {0} : A r+1 < c x (t) } . (31) 
k 

6. For any k G B let Sk = ^2 Aj + (d— k ) Afc + i . Then r\(sk) = k and c\(sk) = Xk+i ■ Moreover, 

i=i 

the set A of discontinuity points of r\ satisfies that 

A = {te(t , +oo) : c x (t) = A rA (() +1 } = c^{Xi : Aj / X d } = {s k : k G B} . 

7. Given t £ [to , +oo), such that c\(t) = X m (even if m ^ B), then 

• t G A <==> X m / X d . 

• r A (t) = c A (t) = Ai <=^ t = dXi . 

• If A m 7^ Ai , then r x {t) = max{j G I<2 : Xj > X m } and 

m r x {t) 

t = Y, X i + ( d - m ) X m=^2 Xi + (d- r x (t) ) X m . (32) 

i=l i=l 

Proof. Given t G [to , dXi) and 1 < r < d — 1, then r = r x (t) if and only if 

c\(t) = Px(r , t) > A r+ i and p x (r - 1 , t) < X r . (33) 

On the other hand the map t i— > p x (r,t) is linear, continuous and increasing for any r fixed. From 
these facts one easily deduces the right continuity of the map r x , and that the map c x is continuous 
at the points where r x is. We can also deduce that if c x (t) ^ A rA ( t ) +1 then r x is continuous (i.e. 
constant) near the point t. Observe that, if r = r x (t), then 

V V M) = LM^r A r > PA( r,t)>A r+1 => rGS. (34) 

a — r + 1 

Using that r A (t) = for t > <i Ai , that c A (to) = A^ , and the right continuity of the map r x , we 
have that A = {te(t , +oc) : c A (t) = A rA ( t)+ i} = c A " 1 {A i : Ai / A d }. 

Hence, in order to check the continuity of c x we have to verify the continuity of c x from the left at 
the points t > to for which c A (t) = A rA ( t ) +1 . Note that, if r = r A (t), then r £ B and 

c\{t) = p x {r , t) = J = A r+ i ==> t = V Aj + (d - r)A r+ i . (35) 

d — r t—' 

i=i 

If c A (t) = Xd then t = to and there is nothing to prove. Assume that c x (t) = X rx ^ + i > X d ■ Then 
f = max{j G I d -i '■ Aj = A r+ i} is the first element of B after r. Note that A f -s + i < Xf = X r+ i . We 
shall see that if s < t near t, then r x (s) = f. Indeed, as in Eq. ([35]) . 



Pa(^ , t + sc) = 3 r = A r+ i + > Xf + i and 
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1 + ^ \ {d ~ r)Ar+1 ~ S=Hj A J + X X g X 

p\{r - 1 , i + x) = — J — = A r+ i + — — < A r+ i = X? . 

a — r + 1 a — r + 1 

for x G (—£,0] if e > sufficiently small. By Eq. ([53"j) we deduce that r A (t + i) = f / r A(t) for 
such an x, so that t & A (r\ is discontinuous at t). On the other hand, 

x 

c\{t + x) = p x (r, t + x) = X r m +1 + - lim c\(t + x) = K x (t)+i = c\(t) . 

w a — r x->0~ 

This last fact implies that cx is continuous and, since rx is right-continuous, that cx is a piece-wise 
linear and strictly increasing function. With the previous remarks, the proof of all other statements 
of the lemma becomes now straightforward. □ 

5.9. Fix A G R+ ^. Take an integer m < d. Recall that if m > we denote by 

m 

s* = S *(X , m) = c^ 1 (A m ) = Ai + (d - m) X m . 

i=i 

Now we rewrite the definition of the maps rx , m and c A j m : If m > and t G [to , +oo) let 



f*A,m(*) = min{r G U {0} : c A , m (t) > A r+ i} . 

If m < and t G [to > +oo) we define c Ajjn (t) = c A (t) and r A)m (i) = r A (i). Note that, by Eq. ([3"T]) . 
rx,m(t) = r\(t) for every i < s* . A 

Corollary 5.10. Let X G Ri^ and fix an integer m < d. Then the map r\ m is not increasing 
and right continuous and the map c Ajm is strictly increasing and continuous on [tr A, +oo). 

Proof. The mentioned properties of the map cx , m were proved in Remark 13.131 (whose proof uses 
Lemma [578]) . With respect to the map rx m > the statement follows from Lemma 15.81 and [5791 



c x (t) if t < s* 



Minimizers for submajorization in A t (A , m) for m < 0. 

The following Lemma is a standard fact in majorization theory. We include a short proof of it for 
the sake of completeness. 

Lemma 5.11. Let a , 7 G MP, (3 G R 9 and x G R such that x < minfc g i p 7^. . Then, 

tr(7, big) < tr(a, (3) and 7 ~< w a => (7, -< w (a , f3) . 

Observe that we are not assuming that (a , (3) = (a , 0)*. 
Proof. Let /i = tr j3 and /? = ^ 1 9 . Then it is easy to see that 

Y, (7^ > » < E ( ai ' z 9 )* ^ I] I" 4 " > for evei T fc 6 l p+q ■ 

iei* ieife ieife 

Since (7^ , x 1 9 ) = (7 , x t q )^, we can conclude that (7 , x t q ) -< w (a , f3). □ 
In the following statement we shall use the maps rx and cx defined in Eq. (|30p (or Definition 13. 10p . 
Theorem 5.12. Fix m < 0. Let A G R^, to = t r A and t G [to , +00). Consider the vector 

v = v\(t) = (Ai , . . . , A rA(t) , c A (t) , . . . , c A (t) ) if r A (t) > , (36) 
or v = 4 l<j = q(A) Id G At(A , m) i/r A (t) = 0. T/ien 1/ satisfies that 

v G Af(A , m) , tr 1/ = t and 1/ /i /or every // G A 4 (A , m) . (37) 
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Proof. Given i G [to , +00), we denote by r = r\(t). If r = then, 

t>d\ 1 and A = A^ => c A (t) = -: > Ai z; = cl rf G A t (A , m) . 

a 

It is clear that such a vector must satisfy that v -< w [i for every [i G A^(A , m). 

Suppose now that r > 1, so that t < dAi . Recall from Lemma 15.81 that in this case we have that 
A r +i < c a(^) < A r . Hence v ^ A and z^ = zA It is clear from Eq. (|15p that tr(z^) = t. From these 
facts we can conclude that v G A^(A , m) as claimed. 

Now let p G A((A , m) and notice that, since fj, ^ A, we get that 

k k k 

^ > ^ Aj = ^ i/j for every 1 < k < r x (t) . 

i=l i=l i=l 

Now we can apply Lemma f5. Ill (with p = r\(t) and x = c\(t) ) and deduce that v -< w fi. □ 
Minimizers for submajorization in A t (X , m). The general case. 

Recall that A f (A, to) = {/1 G : /i ^ A , tr/x > t and /i^-m+i < Aj for every i G I m }, for 

each to G I^-i . In what follows we shall compute a minimal element in A^(A , m) with respect to 
submajorization in terms of the number s* = s*(X , to) = f c^ 1 (A m ) and the maps r\ m and c\^ m 
described in Definition 13.101 (see also 15. 9p . 

Proposition 5.13. Let A G Wl^, to = trA, m G I<2 • If t £ [to, s*(A, m)] ; t/ien t/ze vector 
v = (Ai , . . . , A rA ( t ) , CA(t) , • • • , c\(t) ) 0/ -Eg. (|36|) satisfies that v G A t (A , to). Hence 

tr z/ = t , f d = c^(t) and f /i /or ewery fi £ A t (X , m) . 

Proof. We already know by Theorem 15.121 that G A^(A, 0) and trz/ = t. Using the inequality 
c\(t) < ca(s*) = A m , the verification of the fact that v G A t (A , to) is direct. By Theorem 15. 121 we 
conclude that v -< w /j, for every /1 G A 4 (A , to) C A t (A , 0). □ 

m 

Recall the number s** = TO (Ai) = (d — to) Ai + Yl > s * (with equality <^=^> Ai = A m ) defined 

' i=i 

in Eq. flU (see also Remark I3T3D . 

Definition 5.14. Let A G to = tr A and to G Z such that m < d. Fix t G [to , +00) and 

denote by r = r\^ m (t) . Consider the vector v\^ m (t) G given by the following rule: 

• If m < then f A , m (t) = v\(t) = (Ai , . . . , A r , c A , m (t) ld-r)- 
If to > 1 we define 

• v\,m(t) = (Xi, ... , A r , CA, m (i) ld-r) for t < s* (so that r > to and CA, m (i) < A m ). 

• ^A . m 

(i) = (Ai,...,A 

r > Ca m 

(t) l d _ m , A r+ i , . . . , A m ) for t G (s* , s**), and 

• ^A,m(*) = (cA,m(*)ld-m , Ai , . . . , A m ) for t > s** . 
If Ai = A m , the second case of the definition of z^a m 

(t) disappears. A 

In the following Lemma we state several properties of the map v\ t m(-), which are easy to see: 

Lemma 5.15. Let A G M£_^, and m G Z such that m < d. The map z^A,m( - ) of Definition 15. 141 has 
the following properties: 
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1. By Remark 13.131 the vector v\ m (t) G Mi* (i.e. it is decreasing) for every t. 

2. The map z^A,m( - ) is continuous. 

3. It is increasing in the sense that t\ < t<i =>■ u\ 1 m(tl) ^ ^A,m(*2) • 

4. More precisely, for any fixed k Eld, the fc-th entry ^\ m (t) of v\, m {t) is given by 



"? } (*) 



"■m 



max {Afc , ca , m (t)} if k < d — m , 

min | max{Afc , CA, m (t)} , Aj| if k = d — m + i , i G I r , 

5. The vector v\ tm (t) G A t (A , m) and tr v\,m{t) = * for every t G [to , +oo). □ 
We can now state the main result of this section. 

Theorem 5.16. Let A G Ri^, to = tr A and i G [to , +oo). Fix m 6 Z suc/i t/taf m < d. Then the 
vector u\ m {t) defined in \5.1J\ is the unique element o/A^(A, m) suc/i t/iat 

v\,m{t) < w H for every fj, G A* (A , m) . (38) 

Proof. If m < the result follows from Theorem 15.121 Suppose now that m > 1. By Lemma 15.151 
the vector v\, m {t) G A t (A, m) and trz/x,m(i) = t for t G [to , +oo). In Proposition 15.131 we have 
shown that V\ m (t) satisfies ([38]) for every t G [to , s*(A, m)]. Hence we check the other two cases: 

Case t G (s* , s**): fix fx G At (A , m) such that tr/i = t. Let us denote by r = r\ tTn (t), 

a= (fix, ... , ll r ) , /3 = (fl r +l , • • • , ^ r+ d_ m ) , 7 = (/V+d-m+1 , . . . , /id) , 

p = (Ai , . . . , A r ) and oj = (A r+ i , . . . , A m ). Then 

H = {a , ft , i) and ^A,m(*) = (p , c A , m (t) l d - m , w) ■ 

Since fx G A t (A , m) and tr TO (i) = tr /i = t, then 

p^a , and tr (a , /?) > tr(p , c A , m (t) ld-m) ■ 

Then we can apply Lemma 15.111 to deduce that (p , c\ m (t)\d—m) (p^i /-0- Using this fact 
jointly with 7^0; one easily deduces that v\ im [t) -< \i (because trp = tTV\ im (t) = t). 

The case t > s** for vectors fj, G A^(A , m) such that tr p = t follows similarly. 

If we have that p G Ap(A , m) with tr p = a > t, then 

p G A a (A (*) < ^A,m(a) -< p => ^A,m(*) <w P , 

where the first inequality follows from Lemma 15.151 □ 

Step 3: minimizers for submajorization in Ut(So,m) 

Let Sq G A^(i(C) + and let t > to = tr(So). Notice that Corollary 15.71 together with Theorem 
15. 161 show that the sets Ut(So, m) have minimal elements with respect to submajorization. We shall 
describe the geometrical structure of minimal elements in Ut(So , m) with respect to submajoriza- 
tion for any m < d in terms of the geometry of Sq. We shall see that, under some mild assumptions, 
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there exists a unique St G Ut(So , m) such that A(Sf) = v\, m {t) (the vector of Theorem [5716] defined 
in I5.14|) . In order to do this we recall a series of preliminary results and we fix some notations. 

Interlacing inequalities. Let A G U(d) with X(A) eM di and let P = P 2 = P* G M d (C) + be a 
projection with rkP = k. The interlacing inequalities (see [3]) relate the eigenvalues of A with the 
eigenvalues of PAP G H(d) as follows: 

X d - k+l (A) < Xi(PAP) < Xi(A) for every i G I fc . (39) 

On the other hand, if we have the equalities 

Xi(PAP) = Xi(A) for every i G l k then PA = AP , (40) 

and that P(P) has an ONB {^jigi*. such that A hi = Aj /ij for every i G Ifc. Indeed, if Q = I — P, 

d 

then tr QAQ = ^TJ Aj(-A). The interlacing inequalities applied to QAQ imply that 

i=k+l 

X k+j (A) < Xj{QAQ) for j G =>• A, (QAQ) = A fc+i (A) for j G . 

Taking Frobenius norms, we get that 

d 

\\A\\ 2 2 =Y J X i (A) 2 = \\PAPf 2 + \\QAQ\\l PAQ = QAP = , 
i=i 

so that A = PAP + QAQ. The Ky-Fan inequalities (see [3]) assure that 

k 

^2 Xi(A) = max | tr PAP : P G M d (C) + , P = P 2 = P* and rkP = k } . (41) 
i=l 

As before, given an orthogonal projection P with rkP = k such that 

k . , , 

* — ■* Rol Hoi 

tr PAP = H A ) ^ Xi(PAP) = Xi{A) for i G I k ^ PA = AP, (42) 

i=l 

and R(P) has an ONB of eigenvectors for A associated to \i(A) , . . . , Xk(A). If we further assume 
that Afc(j4) > Xk + i(A) then in both cases PU|) and (H2J) the projection P is unique, since the 
eigenvectors associated to the first k eigenvalues of A generate a unique subspace of C d . 

Notations. We fix a matrix 5 G M d (C) + with A(5) = A = (Ai , . . . , X d ) G . We shall also 
fix an orthonormal basis {/ii}iei d of C rf such that 

S hi = Xi hi for every i El d . 

Any other such basis will be denoted as a "ONB of eigenvectors for S , X " . 

Lemma 5.17. Zei P G A4 d (C) + and r G I^-i such that X(S + B) = (Ai , . . . , A r , a), /or some 
a G M^ _r ^ such that ol\ < A r . Let A4 r = span{/ij : i G I r } and P = Pvt,. . Then 

PB = BP = PBP = . 

r 

Proof. Since rkP = r and tr(PSP) = ^ Aj , then the Ky Fan theorem ([41 p assures that 

i=i 

r r 

< tr(PPP) = tr(P(S + B)P) - tr(PSP) < ^ X^S + B) - ^ X { = . 

i=i i=i 

Since P > 0, we have that tr(PPP) = => PBP = PP = PP = 0. □ 
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Proposition 5.18. Let r G K^-i) then for each c G [\ r +i , X r ] there is a unique B G A4a(C) + such 
that X(S + B) = (Ai , . . . , A r , cl^_ r ). Moreover, it is given by 

d—r r d 

B = ^^(c — \ r +i) h r +i <S> h r+ i and S + B = A, • hi® hi + c • hi <S> hi . (43) 

i=l i=l i=r+l 

Proof. Let .M r = span{/ij : i 6 I. r } and P = P» r . Suppose that P £ 7V4d(C) + is such that 
A(5 + P) = (Ai , . . . , A r , cl d _ r ). Then, by LemmaEE] BP = PB = 0. Hence 

Eq. 02) 

Aj Alj 

i=l 



P(S + P)P = (5 + P)P = SP = Ai hi ® /ij (5 + P)Q = cQ , 



d—r 

where Q = I — P. Hence P = PQ = cQ — S Q = X^( c — A r+ j) /i r+ j <S> h r+ i . □ 

i=l 

Remark 5.19. In Lemma |5.17| we allow the case where A r = A r +i = a\ . In this case we could 
change h r by h r +i (or any other eigenvector for A r ) as a generator for A4 r . The proof of the Lemma 
assures that we get another projector P' which also satisfies that BP' = 0. 

Similarly, in Proposition 15.181 we allow the case where A r = A r+ i = c . By the previous comments, 
the projection P in the proof of Proposition 15.181 is not unique. Nevertheless, in this case the 
positive perturbation P is unique, because we have that rk P < d — m (this follows from the fact 
that (c — A r+ i) h r+ \ <g) h r+ i = 0). In fact B = cQ — S Q, where Q is the orthogonal projector onto 
the sum of the eigenspaces of S for the eigenvalues A, < c. A 

Lemma 5.20. Let m G I^-i an d B G A4d(C) + with rkP < d — m. Assume that 

X(S + P) = (cl d _ m , Ai , . . . , A m ) , 

for some c > X\ . Then there exists an ONB {wj}iei d of eigenvectors for S , A such that 

d—m m d 

B = y~^(c- X m+i ) v m+i <g> v m+i so that S + P = Aj • Vi ® Vi + c • Vi <g> Vi . (44) 

i=l i=l i=m+l 

Lf we assume further that X m > A m +i then B is unique, and Eq. (|44p holds for any ONB of 
eigenvectors for S , A . 

Proof. Note that, since rkP < d — m, then 

d—m d 

Xi(B) = ti B = tr{B + S) - tr S = c{d-m)- Xj . (45) 

i=l j=m+l 

Take a subspace M C C n such that P(P) C and dim = d — m. Denote by Q = P^ . Then 
QBQ = P, and the Ky-Fan inequalities (|4ip for S + B assure that 

tr(QSQ) = tr(Q(5 + B)Q) - tr P 

d-m d 

< Yl Xi{S + B)-tiB = c{d-m)-txB W £ Aj . 

i=l j=m+l 

The equality in Ky-Fan inequalities (for —5) force that 7V4 = span{t> m+ i , . . . , Vd}, for some 
ONB {vi}i & i d of eigenvectors for S , A (see the remark following Eq. (|4"2"|) ). Thus, we get that 

d—m 

Q S = S Q = A m+ j v m+i <g> v m+i . Since P(P) C M then P = I - Q < P ker B , and 
i=l 

m 

PP = P(S + B)P = SP = ^XiVi®Vi E ^T {S + B)Q = cQ . 

i=i 
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Therefore we can now compute 

d—m 

B = BQ = (S + B)Q-SQ=J2(c- \ m+l ) v m+l ® v m+i . (46) 

i=i 

Finally, if we further assume that X m > \ m +i then the subspace M. = span{u m+ i , . . . , v^} is 
independent of the choice of the ONB of eigenvectors for S , A . Thus, in this case P is uniquely 
determined by (|4"6j) . □ 

Proposition 5.21. Let m G ]Lj-i an d B G A4d(C) + with rkP < d — m. Let c G E smc/i i/mi 
A r +i < c < A r , /or some r < m. Assume that 

X(S + B) = ^Ai , . . . , A r , cl^-m , A r+ i , . . . , \ r 

Then there exists an ONB {vi}i e i d of eigenvectors for S , A such that 

d—m m d 

B = ^ (c - X m +i) Vm+i ® Vm+i SO that S + B = y~] Xj ■ Vj ® Vj + C ■ ^ Vi®Vi . 
i=l i=l i=m+l 

If we further assume that X m > A m +i i/ien P zs unique. 

Proof. Consider the subspace M. r = span{/ii , . . . , h r } and P = Pm t ■ By Lemma f5. 171 we know 
that P B = B P = 0. Let S\ = S , |_ A/( ± and Pi = B\ M± (= P) considered as operators in L(Ai^r). 
Then S\ and Pi are in the conditions of Lemma 15.201 so that there exists an ONB {wi}i^i d _ r of 
M-^r of eigenvectors for S\ , (A r+ i , . . . , A^) such that 

d—m 

B = Bi= y^(c- A m+i ) w m+i <g> w m+i . 

Finally, let {vi}i G i d be given by Vi = hi for 1 < i < r and v r+ i = Wi for r + 1 < i < al. Then {vi}i^i d 
has the desired properties. Notice that if we further assume that X m > A m+ i then Lemma 15.201 
implies that Pi is unique and therefore P is unique, too. □ 

Remark 5.22. With the notations of Lemma 15.201 assume that X m = A m +i . In this case P is not 
uniquely determined. Next we obtain a parametrization of the set of all operators P G A1d(C) + 
such that X(S + P) = (clrf_ m , Ai , . . . , X m ). Consider p = (d — m) — : Aj < A m+ i} and 
notice that in this case we have that 1 < p < #{z : Aj = A m+ i} = dimker(S' — A m+ i I). Then, for 
every P G M. c i{C) + as above there corresponds a subspace M = span{/ij : m + l<i<m + p\cz 
ker(S' — X m I) with dim M = p such that 

d—m 

P = (c - X m ) Pj^f + y \ (c- X m+i ) h m+i <g> h m+i . (47) 

i=p+l 

Conversely, for every subspace M C ker(S' — X m I) with dimAA = p then the operator P G .Md(C) + 
given by (|4"T|) satisfies that A(S + P) = (clrf_ m , Ai , . . . , A m ). Since the previous map P h4 Pv 
is bijective, we see that the set of all such operators P is parametrized by the set of projections 
Pj\f such that J\f C ker(5" — X m I) is a p-dimensional subspace. Moreover, this map is actually an 
homeomorphism between these sets, with their usual metric structures. 

Finally, if we let k = #{i : Aj > A m } then the set of operators S + P such that P G A4d(C) + with 
rkP < m — d and such that X(S + B) = (ctd-m , Ai , . . . , A m ) is given by 

k d—m 

S + P = ^ Aj • hi <S> hi + A m • P^fi + c • (P^ + ^ h®hi) , 

i=l i=p+l 
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where J\f C ker(5' — A m I) is a subspace with dimTV = p and N ' = kei^S 1 — A m+ i I) n A/" . 

As a consequence of the proof of Proposition 15.211 we have a similar description of the operators 
B of its statement. A 

Proofs of the main results 

Proof of Theorem \3.12l It is a consequence of Corollary 15.71 Theorem 15.161 and the results of this 
section (Lemma 15.201 and Propositions 15.181 15.2ip . The arrow (b) ==>- (a) in Item 2 follows by 
Definition 15.141 and the fact that both matrices So an d B are diagonal on the same basis (as, for 
example, in Eq. ([35]) ). □ 

Proof of Proposition \3.14\ It is a consequence of Corollary 15.71 Definition 15.141 Lemma 15.151 and 
Theorem 15.161 □ 

Acknowledgment. The authors would like to thank the reviewers of the manuscript for several 
useful suggestions that improved the exposition of the results contained herein. 
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